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22 October 1968 


MEMORANDUM FOR: Deputy Director for Support 


THROUGH : Chief, Assessment and Evaluation Staff, OMS 
SUBJECT $ Periodic Progress Report 
REFERENCE : Memo dated 26 July 1967 for DDS fr D/MS, subj: 


Proposed Systems Analysis of Psychological Data 


1. During this reporting period, major emphasis was placed upon 
intensively analyzing relationships among PATB data, training outcomes, 
and rated job performance and potential for Career Trainees. An attach- 
ment summarizes these relationships. In addition, progress was made in a 
number of other areas: an attitude questionnaire was administered to 71 
DDP-bound CTs in training; the relationships between personality patterns 
measured by the California Psychological Inventory and job performance and 
potential were studied; comparisons were made on PATB intellectual measures , 
among groups of CIs who resigned and those who remained; and comparisons of 
test profiles of CIs and non-CTs were completed. 


2, A summary status report for the CT Systems Study is attached. This 
table briefly describes completed, ongoing, and planned research of the study. 


3. In order to portray graphically the relationships among PATB variables, 
training performance and on-the-job performance, a number of expectancy tables 
were prepared; representative ones are attached to this memorandum. <A word of 
caution about the meaning and possible application of these tables is in order. 
Expectancy tables can and often do change over time as people from different 
backgrounds are selected for new jobs. In addition, they should not be used 
alone in arriving at recommendations. Sound professional use of psychological 
tests requires psychologists to combine and integrate a variety of test and 
non-test information to arrive at meaningful recommendations. Thus, these 
expectancy tables are prepared primarily to illustrate some of the relation- | 
ships of our test data to criterion data rather than as specific guides for 
selection and placement decisions. 


4, An overview of the major findings to date of the CT Systems Study is 
attached. More detailed reports have or will be prepared covering these topics. 


SECRET 


Approved For Release 2003/04/29 : CIA-RDP84-00780R003700090006-9 


L: 


Approved For Release 2003/04/29 : CIA-RDP84-00780R003700090006-9 
SECRET 


SUBJECT: Periodic Progress Report 


5. We would like to mail to applicants at the time they are offered 
appointments to the CIP the questionnaire previously submitted to you on 
9 August 1968 (Subj: Attitudes of CTP Applicants), designed to measure 
attitudes relevant to their accepting or declining Agency employment. 
However, if you feel that such a procedure is not in the best interests of | 
the Agency, we could administer the questionnaire to CTP applicants at the - 
time of their headquarters visits. We ask your decision on which procedure. 
to employ. 


6. As before, Agency interest and cooperation in the CT Systems Analysis 
remains high. 


5X1 25X1 


Acting Chief, Research Branch 
Assessment and Evaluation Staff 
Office of Medical Services 


eting Chairman, Task Force on systems Analysis 
f Psychological Data Pertaining to Career Trainees 


Attachments: 

A. Summary status report of systems analysis of 
psychological data pertaining to Career 
Trainees 

B. Overview of major findings of CT Systems 
Study to date 

C, Significant relationships among PATB variables, 
Manpower Ratings of performance and potential, 
and training evaluations 

D. Expectancy Tables: Representative significant 
relationships among PATB test variables, 
Manpower Retings of performance and potential, 
and training evaluations 


OMS/ AES/GYD:mak 
Distribution: 
Orig & 1 ~ Addressee, w/attachments 
1 ~ D/MS, w/attachments 
1 - Each member of Task Force, w/attachments 
2 = AES/OMS 
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ATTACHMENT A 


SUMMARY STATUS REPORT OF SYSTEMS ANALYSIS OF PSYCHOLOGICAL, 


DATA PERTAINING TO CAREER TRAINEES 


SECRET 
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BASIC OBJECTIVES OF STUDY: 


QUESTIONS ABOUT SELECTION AND 


MANAGEMENT PROCESSES 
Who applies to the CTP? 


Whom does the Agency hire 
as OTs? 


Who does well in training? 


Who works in DDI? DDP? DDS? 
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SUMMARY STATUS REPORT OF SYSTEMS ANALYSIS OF PSYCHOLOGICAL 


DATA PERTA 


“COMPLETED 


Comparison of Hires and 
Non-Hires on intellectual, 
temperament, and work 
attitude variables (report 
completed). 


Development of questionnaire 
to tap factors relevant to 
applicants! decision to 
accept or decline appoint- 
ments to CTP 


Relationships between PATS 
data and training evalua- 
tions for all CIs in 
Professional Manpower Study 
(draft completed). 


Comparisons of CTs in DDI, 
DDP, and DDS on vocational 
interest and work attitude 
variables (draft completed). 


Approved For Release 2003/64 


CAREER TRAINEES 


UNDERWAY 


Description of test and 
background characteristics 
of CT applicant pool (report 
in preparation). 


Comparison of Hires and Non- 
Hires on vocational interest 
scales and background ex- 
periences. 


Study of relationships of 
psychiatric rating scale 
and OMS dispositional data 
with PATB and personnel 
variables. 


Comparison of CTs and Non- 
CTs on PATB variables 
(report in preparation). 


Relationships between PATB 
data and training evalua- 
tions for all Offs on whom 
both training and test data 
are available. 


Comparisons of CTs in DDI, 
DDP, and DDS on intellectual, 
temperament, and background 
information variables. 


2ST CIA-RDP84-00780R003700090006-8 


PLANNED 


Selected comparisons of 
CT applicants with applicants 
to analogous programs (FSO, FSEB). 


Selected comparisons of CTs 
with trainees in analogous 
programs (FSO, FSEE). 


Administration of questionnaire 
to tap factors relevant to 
applicant's decision to accept 
or decline appointments. 


Reasons for not hiring applicants 
will be sought on Non-EOD 
applicants; these reasons will 
be correlated with PATB. 


Comparison of external and 
internal CTs on PATB and 
selected personnel and admin- 
istrative variables (promotion 
rate, fitness reports, etc.) 


Development of “index of 
assignment stability" to 
identify concommitants of 
job mobility within the Agency. 


Who stays with the Agency? 


Who is satisfied with his job? 


Who performs well? And 
advances? 


ae sn Sear ore me te ee tee YO ek NY SS FN hh etn ee ey A 


*Ratings gathered by the Committee 
on Professional Manpower, a 
Committee established by the 
Executive Director to examine the 


fessional employees 
THe ay een dat y aed eae 
Years 1863-67, ¥ Curing Fiscal 
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COMPLETED 
ee 


| Comparisons of stays," 
"quick dropouts” and "slow 
dropouts" on intellectual 
variables (draft completed). 


Attitude survey of sample of 
DDP-bound CTs. 


Relationships between PATB 
intellectual, temperament, 
work attitudes, and voca- 
tional interest varjables 
and Manpower Ratings of job 
performance and potential 
(draft completed). 


Relationships between Calif- 
ornia Psychological Inventory 
variables and Manpower Ratings 
of job performance and potan- 
tial (report completed). 


Relationships between 
performance in CT training 
courses and Manpower Ratings 
of job performance and poten- 
tial (draft completed), 


Relationships between college 
quality and Manpower Ratings 
of job performance and poten- 
tial (report completed). 


SECRET 


UNDERWAY 


Study of relationships 
between clinical interpreta- 
tion of PATB tests and job 
performance and potential. 


Study of relationships 
between comprehensive 
assessment data and job 
performance and potential. 


Analysis of relationships 
between military rank and 
job performance and potential. 


Analysis of relationships 
between educational level 
achieved and job performance 
and potential, 


PLANNED 


Comparisons of "stays," "quick 
dropouts" and "slow dropouts" on 
temperament, work attitudes, 
vocational interest, and back- 
ground. variables. 


Analysis of relationships between 
reason for resignation (reported . 
at exit interviews) and prior 
test and personnel variables. 


Attitude surveys of DDP, DDI, 
and DDS CTs in training and 
on-the-job 


Analysis of relationships between 
attitudes, test performance, and 
job performance. 


Analysis of relationships between 
fitness report ratings, promo- 
tion rates, and PATB variables. 


Analysis of relationships between 
refined experimental ratings 
(supervisor, peer and subordinate 
ratings) and PATB variables. 
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ATTACHMENT B 


OVERVIEW OF MAJOR FINDINGS OF THE CT SYSTEMS STUDY TO DATE 


SECRET 
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22 October 1968 


OVERVIEW OF MAJOR FINDINGS OF THE CT SYSTEMS STUDY TO DATE 


I. Relationships between Test Results and Job Performance and Potential 


1. 


Qe 


36 


All major portions of PATB show significant relationships with the 
performance and potential ratings gathered by the Committee on 
Professional Manpower (N=380 CTs). 


More and larger relationships emerged between PATB tests and job ¥ 
performance and potential for a group of non=-CT professionals (1¥=360). 
The non-CT sample produced nearly double the number of significant 
relationships found for the CTs. In all likelihood, this difference 
is primarily due to restriction of the range of test scores in the 

CT sample «= the CT sample was more homogeneous in intellectual 
ability, work attitudes, interests and temperament. 


The pattern of relationships which emerges is not complete -- no , 
PATB test is significant for all groups (DDI, DDP, and DDS CTs} . 
and not all tests are significant for any group. 


Rated job performance and potential of DDP CTs are harder to predict » 
than performance and potential of DDI or DDS CTs. 


Of the four major portions of PATB (excluding the Baekground Informa- 

tion Questionnaire which has not been thoroughly studied) -- intellectual 
measures, temperament measures, work attitudes, and vocational interests -~- 
vocational interests were most consistently and strongly related to rated 
job performance and potential. Intellectual measures were next, followed 
by work attitudes and temperament measures. 


The California Psychological Inventory, a relatively sophisticated 
personality inventory not included in the present Professional Applicant 
Yest Battery, predicts job performance and potential of CTs significantly 
better than any other single group of tests currently in PATB. 


One of the major reasons why larger relationships did not emerge may 

be due to the ratings themselves. Within each of the directorates, a 
wide range of jobs requiring many different types of skills is found. 
More refined studies are needed in which people doing similar jobs are 
studied together, with more than one person making ratings for each 
individual. 


ioe! 
ty 
cf 
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II. Relationships between Test Results and Performance in CT raining Courses 


Note: To date, all analyses involving training evaluation data have 
been limited to CIs on whom Manpower criterion ratings were available. 
Typically this has meant that less than one-half of the available 
training data in any course has been related to PAT'B; subsequent 
analyses will incorporate these additional data. 


1. The size and number of significant relationships found between PATB | 
tests and training outcomes vary considerably from course to course. — 
Perhaps the adjective "moderate" best describes and summarizes the 
magnitude of the test-training linkage. Comparatively speaking, more ; 
and larger significant relationships were found in this linkage than | 
in the one between tests and rated job performance and potential. 
This may be due in small part to the shorter period of time that , 
elapses between testing and training than between testing and obtaining 
job ratings; hence, there are fewer interpolated experiences and 
developments to impinge on the relationship and mask its true size, 


2, It appears that those courses taken by all CTs (Orientation, Communism, 
and Intelligence Techniques) are more predictable by our tests than 
those courses taken only by Cis entering a particular Directorate. 

The ITC and Communism courses are most strongly related to PATB with 
tests and scales from the intellectual, personality, work attitudes, 
and vocational interests areas all having significant relationsuips 

with these training courses. 


3. The significant relationships that emerged between PATB and training 
very often make good sense in terms of our understanding of what our 
tests measure and what we assume good performance in the specific 
training course might require. Thus, for example, performance in the 
Support Services Course, which deals extensively with matters of 
accounting, finance, and logistics, relates significantly to tests of 
arithmetic reasoning, computational skills, and having interests 
Similar to accountants. The ITC, which puts a premium on verbal 
skills and interests, relates significantly to tests measurin, 
vocabulary, reading comprehension, ability to interpret chart/graph 
data, and vocational interest scales concerned with writing. 


III. Relationships between Performance in CT Training Courses and Job 
Performance and Potential 


1. Relationships between overall training evaluations and the individual 
Manpower Ratings of job performance and potential are typically 


significant and of moderate size. Performance and potential seem Pi 
to be about equally predictable from training data. 


aps 
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V. 
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36 
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Performance in the Intelligence Techniques Course and the Operations 
Course appear particularly predictive of the Manpower job ratings -- 

a median correlation of .26 was found and all correlations reached 
statistical significance. Training outcomes in the CT Communism 

Course and the Intelligence Production Course were next most highly 
related to the job ratings. Least predictive of job performance te 
and potential was the Support Services Course for CTs -- no significant 
relationships -- followed by 0.C., Phase II and the Clandestine Services 
Records II courses -- each having one significant relationship. 


Although the moderate relations found between trainin: and job ratings 
make good sense in that training often requires simulated job behavior, 
there remains the possibility that the job ratings of performance and 
potential are partly contaminated by the rater's knowledge of the 
ratee's training record -- hence a self-fulfilling prophecy. 


Comparison of CT Hires and Non-Hires 


1. 


ee 


On all measures of intellectual ability, the Hires were clearly he 
superior in average performance to the non«Hires. 


Hires consistently express greater willingness to accept a wide 
variety of job requirements and/or restrictions than non-Hires3; 
overall, the Hires appear more flexible. 


Differences in temperament scores between Hires and non-Hires were 
not significant. 


Comparisons of CTs in DDI, DDP, and DDS on Vocational Interests and 
Work Attitudes 


i. 


Qe 


DDP trainees are more willing to work in jobs involving potential 
hazards, live in a socially deprived area, endure annoying work 
environments, be subjected to security restrictions, be physically 
active, and work at a changing, unpredictable pace than DDS or DDI 
trainees. DDI trainees are most reluctant toward these job demands, 
with DDS trainees falling between the DDP and DDS groups. 


DDI and DDP CTs tend to have interests dissimilar to people in 
business-sales and scientific occupations and interests similar to 
people in verbal-persuasive occupations (law, journalism, etc). DDS 
CTs tend to have interests similar to people in business-sales 
occupations and dissimilar to people in verbal-persuasive and 
scientific areas. 


=3- 
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Comparisons of CT's and Non-CT Professionals on PATB Variables 


1. On the average, CIs score higher on all intellectual variables than 
non=CTIs. 


2, On temperament measures, CIs appear more outgoing, socially assertive, 
and quick-working than non-CTs. 


3. On 14 of the 15 work attitudes, CIs are more eager and adaptable than 
non-CTs,. 


h, CTs have interests more similar to people in the verbal persuasive 
and social service/managerial areas than non-CTs. Non-Cls have 
stronger interests in the scientific and outdoor technical areas 
than CTs. 


Comparisons of Intellectual Levels of CTs Who Leave the Agency with X 
Those Who Remain 


1. For the first 15 CT classes (July 1951 to September 1958), “quick 
dropouts" -- those who left the Agency in less than one year -- 
exceeded those who remained on seven of eight intellectual variables. 
A similar pattern was found for “slow dropouts” -- those who stayed 
with the Agency five years before leaving -~ who exceeded the "stays" 
on six of eight intellectual tests. 


2, For the next 20 CT classes (September 1959 to February 1967), CI 
trainees who left the Agency in their first year did not score higher 
on intellectual measures than those who remained as career employees. 
However, CIs who left the Agency after being assigned to operating 
positions were superior to those who remained on all intellectual VERO Re 


Military Service, Educational Level Attained, and Job Performance 
and Potential 


1. No relationship emerged between presence or absence of military 
service and rated job performance and potential of CIs, Similarly, 
rank attained in the service was unrelated to ratings of job performance 
and potential. 


2, Over 99 per cent of CTs in the Manpower Study had bachelors or masters 
degrees. Within this relatively narrow range of educational level, a 
small relationship was found between highest degree obtained and rated 
job performance and potential. ‘Those CTs who had obtained their masters 
degrees received, on the average, very slightly higher ratings of 
performance and potential than Cls with only bachelors degrees. 


ali 
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IX. College Quality and Job Performance and Potential 


1. A relationship was found between the quality of the undergraduate 
colleges attended by CTs and their rated job pgtential. Those CTs 
graduating from “high-quality” colleges (not limited to Ivy League 
schools) received, on the average, higher ratings of job potential . 
than CIs from "lower-quality” schools. oe 


2. Comparable relationships between college quality and rated job 
performance emerged only for DDP CTs. 


X, Attitude Survey of CT Sample in Training 


1. Preliminary analyses of attitude data from 71 CTs in operations x 
training indicate that this group has good morale and a high degree 
of confidence in the management of the CT Program. Moreover, 8h. to 
90% of these CIs responded in the favorable direction to questions 
concerning staff-trainee interpersonal relationships. 


2, Less positive attitudes were expressed toward selected aspects of the 
training experience. Thus, for example, sizeable minorities commented 
unfavorably on the degree of intellectual stimulation provided by the 
program (28%) and intimated that there should be more on-the-job and 
less formal training (43%). By far, the area in which the most wide- 
spread concern was expressed involved provisions for feedback, evalua- 
tion, and especially job assignment. 

3. Although based on limited data, it appears that Internal CTs respond \ f 
more favorably to the training program than Externals. A full report | 
of this study is in preparation and plans for additional administra- 
tions of the attitudinal questionnaire are being discussed with c/CTP, 


-5- 
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ATTACHMENT C 


SIGNIFICANT RELATIONSHIPS AMONG PATB VARIABLES, MANPOWER RATINGS 
OF PERFORMANCE AND POTENTIAL, AND TRAINING EVALUATIONS 
(I) Significant Relationships between PATB Variables and Manpower Ratings 
of Performance and Potential 


(II) Significant Relationships between PATB Variables and Overall Training 
Evaluations for Courses Taken by All Career Trainees 


(IIL) Significant Relationships between PATB Variables and Overall Training 
Evaluations for Courses Designed for Specific Directorates 


(IV) Significant Relationships between Training Evaluations and Manpower 
Ratings of Performance and Potential 
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SIGNIFICANT RELATIONSHIPS BETWEEN PATB 
VARIABLES AND MANPOWER RATINGS OF 
PERFORMANCE AND POTENTIAL 


___ Overall CTs 
(N=3'72- 386 males) 


Performance Potential 
Intellectual. Measures 
Ideational fluency + + 
Vocabulary + 
Knowledge of current affairs + 
Language aptitude + 
Temperament Measures 
Self-confidence + 
Work Attitudes: Eagerness 
to Acce or deal with 
Hazards ; - - 
Annoyances - - 
Social deprivation - - 
Unpredictably unstructured work - - 
Physically demanding work - 
Strong Interest Scales: 
Interests Similar to 
Personnel Directors + + 
Public Administrators + + 
Senior CPAs + + 
Production Managers + + 
Accountants + 
Army Officers + 
Psychologists + 
CPA Partners ot 
Dentists - - 
DDS Logistics Officers i) = 
Bankers - 
Real Estate Salesmen - 
+ statistically significant positive relationship 


statistically significant negative relationship 
no significant relationship 


! 
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no sign 
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DDP CTs 
(N=205-217) 
Performance Potential 
intellectual Measures 
Vocabulary + + 
Ideational fluency + t 
Temperament Measures 
Work Attitudes: Eagerness 
to Accept (or deal with 
Hazards - - 
Strong Interest Scales: 
Interests Similar to 
Psychologists + a 
Senior CPAs + + 
Public Administrators + + 
Intelligence Officers + 
Bankers ~- - 
DDS Logistics Officers - od 
Real Estate Salesmen - 
Life Insurance Salesmen - 
+ = statistically significant positive relationship 


statistically significant negative relationship 
no significant relationship 


' 
houou 


no sign 
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DDS CTs 
(u=79-89) 


Intellectual Measures 


Ideational fluency 


Temperament Measures 


Self-confidence 


Work Attitudes: Eagerness 
to Accept (or deal with) 


Work involving analysis of others 

Work requiring mechanical skill 

Extensive supervisory responsibility 
Resourcefulness-demanding work 

Work offering little reward or recognition 
Unpredictable, unstructured work 


Strong Interest Scales: 
Interests Similar to 


Chemists 

Production Managers 

Accountants 

Purchasing Agents 

Army Officers 

Math, Physical Science Teachers 
Forest Service Fersonnel 

YMCA Directors 

Personnel Directors 

YMCA Secretaries 

Engineers 

Carpenters 

Public Administrators 

Senior CPAs 

Presidents, Manufacturing Concerns 
Lawyers 

Musicians 

Author-Journalists 

Artists 


cette tpl AAS i NN A Ah — SE lm CO rem er 


+ 


no sign 


fou ou 


no significant relationship 
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statistically significant positive relationship 
statistically significant negative relationship 
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t++tt 
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DDI Cis 


~ Gay 


Intellectual Measures 


Non-verbal reasoning 
Interpretation of chart/graph data, 


Temperament Measures 


Speed of actions 
Physical activity 


Work Attitudes: erness 
to Accept (or deal with 


Extensive training 

Security restrictions 
Resourcefulness-demanding work 
Work requiring mechanical skill 
Undesirable people 


Strong Interest Scales: 
Interests Similar to 


CPA Partners 

Lawyers 

Real Estate Salesmen 

Life Insurance Salesmen 
Advertising Men 

Presidents, Manufacturing Concerns 
Author-Journalists 

DDS Security Officers 

Dentists 

Farmers 

Forest Service Men 

Physicians 

Aviators 

Carpenters 

Math, Physical Science Teachers 
Policemen 

Army Officers 

YMCA Directors 


. 
T 
~ 


no sign 


“ouow 


no significant relationship 


whe 


Performance 


+ 


statistically significant positive relationship 
statistically significant negative relationship 


Potential 


ett etts 
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SIGNIFICANT RELATIONSHIPS BETWEEN PATB VARIABLES AND OVERALL 
TRAINING EVALUATIONS FOR COURSES TAKEN BY ALL CAREER TRAINEES 


CT cr Intelligence 
Orientation Communism Techniques OFC 
(N=258) (N=333) (N=277) 
Intellectual Measures 


+ 


Knowledge of current + + 
affairs 
Vocabulary + 
Reading comprehension + 
Arithmetic reasoning 
Interpretation of chart/ + 
graph data 
Language aptitude + 
Intellectual composite + 


+++ 4+ 


Temperament Measures 


Solitary - 
Self-confidence - - 
Physical activity - 


Work Attitudes: Eagerness 


to Accept (or deal with) 


Physically demanding ~ - 
work 

Annoyances - - 

Hazards - 

Social deprivation ~ 

Security restrictions - 

Undesirable people - 

Work requiring mechanical - 
skill 


Strong Interest Scales: 
Interests Similar to 


Psychologists 

Architects 

Physicians 

City School 
Superintendents 

Musicians 


++ 44 


+ 
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ct crt Intelligence as 
Orientation Communism Techniques OFC” 
(N=258) (N=333) (N=277) 
cont'd. 


Strong Interest Scales: 
Interests Similar to 


CPA Partners + 

Advertising Men 

Lawyers + 

Author-Journalists 

Persons in Professional 
Occupations 

Dentists - 

Production Managers - 

Farmers - ~ 

Pilots ~ 

Carpenters - = 

Math-Physical SeiLence - 
Teachers 

Policemen - 

YMCA Physical Directors “ 

Office Men = . 

Purchasing Agents - 

Agency Logistics Officers - S 


++ + + 


tht t+ 


* 
OFC -- insufficient data available at time of report -- relationships will 
be reported later. 


+ = statistically significant positive relationship 
- = statistically significant negative relationship 
no sign = no significant relationship 
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SIGNIFICANT RELATIONSHIPS BETWEEN PATB VARIABLES AND OVERALL TRAINING 


TIT 


EVALUATIONS FOR COURSES DESIGNED FOR SPECIFIC DIRECTORATES 


Operations 
Course 
(N=232) 


Intellectual Measures 


Non=verbal reasoning 
Reading comprehension 
Ideational fluency 
Knowledge of current 
affairs 
Interpretation of chart/ 
graph data 
Arithmetic reasoning 
Computational speed 
Intellectual composite 


Temperament Measures 


Outgoing 
Predominance 


Work Attitudes: Eagerness 


to Accept (or deal with) — 
Hazards 


Work offering little 
reward or recognition 
Work requiring mechanical 
skill 
Resourcefulness-demanding 
work 
Work involving analysis 
of others 


Strong Interest Scales: 
Interests Similar to 


Psychologists 
Personnel Directors 
City School Superintendents 
CPA Partners 
Accountants 

Bankers 

Lawyers 

Intelligence Officers 
Architects 

Dentists 

Farmers 

Forestry Service Men 


Intelligence 
Production 
(=90) 


Support 
Services 
Course 


(N=83) 


Operations 
Course IIT 
(N=117) 


+ 
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Clandestine 
Services 

Records II 
(N=56) 
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Operations Intelligence Support Operations Clandestine 
Course Production Services Course II Services 
(N=232) (N=90) Course (N=117) Records II 

(N=83) (N=56) 


cont'd. 


Strong Interest Scales: 
Interests Similar to 


Musicians - 
Advertising Men 
Agency Logistics Officers - b 
Persons in Professional 
Occupations + 


+ 


no sign 


statistically significant positive relationship 
statistically significant negative relationship 
no significant relationship 


Hou 


=le 
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IV 


SIGNIFICANT RELATIONSHIPS BETWEEN TRAINING EVALUATIONS 


AND MANPOWER RATINGS OF PERFORMANCE AND POTENTIAL 


Course Title 


CT Orlentation 
(N=258) 


CT Communism 


(N=333) 


Intelligence Techniques 
(N=2'77) 


orc* 


Operations Course 
(N=231) 


Intelligence Production 
(N=90) 


Support 


(N=8 


Services 


3) 


Operations Course II 
(N=117) 


Clandestine Services 


Records 


it 


(N=56) 


*orc -- 


++ 
no sign 


insufficient data available. 


Ho 


no significant relationship 


Ferformance 


+ 


statistically significant positive relationship 


Potential 


+ 
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‘ATTACHMENT D 


EAPECTANCY TABLES: REPRESENTATIVE SIGNIFICANT RELATIONSHIPS AMONG 
PATB TEST VARIABLES, MANPOWER RATINGS OF PERFORMANCE AND 
POTENTIAL AND TRAINING EVALUATIONS 
(I) Representative Significant Relationships between PATB Test 
Variables and Performance/Potential Ratings 


(II) Representative Dignificant Relationships between PATB Test 
Variables and Overall Evaluations in CT Training Courses 


(III) Representative Significant Relationships between Overall 


Evaluations in Training Courses and Ratings of Job Performance 
and Potential 
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Eg 


REPRESENTATIVE SIGNIFICANT RELATIONSHIPS BETWEEN PATB TEST 


TEST: 
MEASURES : 
GROUP: 
CORRELATION: 


TEST: 
MEASURES : 
GROUP: 
CORRELATION : 


TEST: 
MEASURES : 
GROUP: 
CORRELATION 3 


VARIABLES AND PERFORMANCE/ POTENTIAL RATINGS 
(From Manpower Study) 


Considerations (CON) 
Ability to generate ideas quickly 
Overall CTs (N=376) 


«13 
Performance/ Potential Ratings 
CON Coded Score Bottom Haif Top Half 
(low) 0-3 (N=98) 60% how 
he6  (N=1'76) 50% 50% 
(high) 7-9 (N=102) LO 60% 


Work Attitude - Social Deprivation (SOC DEP) 
Eagerness for work involving social deprivation 
Overall CTs (N=384) 


oil 
Performance/ Potential Ratings 
SOC DEP Coded Score Bottom Half Top Half 
(eager for) O-1 (N=48) 56% Lhd 
2-h (N=23h) 53% M7 
(reluctant 5-7 (N=102)  o% 60% 
towards ) 


Contemporary Affairs Test (CAT) 
Knowledge of current events 
DDI CTs (N=82) 


ele 

Performance/Potential Ratings 
CAT Coded Score Bottom Half Top Half 
(low) O-4 (N=23) 61% 39% 


5-6 (N=39) 56% hud, 
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TEST: Strong Vocational Interest Inventory -- CPA Partner Scale 
MEASURES: Interest pattern in comparison with CPA's 
GROUP: DDI CTs (N=80) 
CORRELATION: .29 


Performance/Potential Ratings 


CPA Partners Bottom Half Top Half 
Interests very dissimilar to (N=27) 59% hi% 
Interests moderately similar to (N=35) 57% 43% 
Interests very similar to (N=18) 39% 61% 


TEST: Confident (CONFDT) 
MEASURES: Self-confidence 
GROUP: DDS CTs (N=86) 
CORRELATION: .12 


Performance/Potential Ratings 


CONFDT Coded Score Bottom Half ~~ fop Half 

(low) 0-3  (N&17) 65% 35% 
n6  (N=50) 56% lie 

(nigh) 7-9 (N=19) 26% 74% 


TEST: Strong Vocational Interest Inventory -- Accountant Seale 
MEASURES: Interest pattern in comparison with accountants 
GROUP: DDS CIs (N=86) 
CORRELATION: 4.23 


een tl 


Accountants Bottom Half Top Half 

Interests very dissimilar to (N=18) 61% 39% 

Interests moderately similar to (N=37) 59% hid 

Interests very similar to (N=31) 35% 65% 
De 
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TEST: Considerations (CON) 
MEASURES: Ability to generate ideas quickly 
GROUP: DDP CTs (N=209) 
CORRELATION: .15 
Performance/ Potential Ratings 
CON Coded Score Bottom Half Top Half 
(low) 0-3 (N=58) 55% 45% 
ye6 (N=95) 48% 52% 
(high) 7-9 (N=56) 37% 63% 
TEST; Strong Vocational Interest Inventory -- Psychologist ocale 
MEASURES: Interest pattern in comparison with psychologists 
GROUP: DDP CTs (N=205) 
CORRELATION: .16 
Performance/ Potential Ratings 
Psychologists Bottom Half Top Half 
Interests very dissimilar to (N=58) 60% hod 
Interests moderately similar to (N=73) 45% 55% 
Interests very similar to (N=74) hod 58% 
MEASURE: College Qualit 
GROUP: DDP CTs (N=195 
CORRELATION: .17 
Performance/ Potential Ratings 
College Quality Bottom Half Top Half 
(low) 36 ~-55.0 (N=45) 64% 36% 
(middle) 55.1-64.0 (N=103) 49% 51% 
(high)  64.1-75.0 (N=47) 32% 68% 
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REPRESENTATIVE SIGNIFICANT RELATIONSHIPS BETWEEN PATB TEST 
VARIABLES AND OVERALL EVALUATIONS IN CT TRAINING COURSES 


Le TEST; Contemporary Affairs Test (CAT) 
MEASURES: Knowledge of current events 
COURSE: CT Communism (N=332) 
CORRELATION: .29 


Overall Performance in Communism 


CAT Coded Score Proficient & below Strong & above 
(low) 0-3 (N&94) 53% h7% 
hu6  (N=200) 39% 61% 
(nigh) 7-9 (N=38) 11% 89% 
Bi TEST; Interpretation of Data (IDY) 


MEASURES: Ability to interpret chart/graph data 
COURSE: Intelligence Production (IPC) (N=90) 
CORRELATION: .21 


Overall Performance in I.P.C. 


IDY Coded Score Proficient & below Strong & above 
(low) 0-3 (N=22) 59% hid 
u6  (N=45) 64g 36% 
(high) 7-9 (N=23) 43% 57% 
36 TEST: Work Attitudes - Analyze (Anal) 


MEASURES: Eagerness for job requiring analyzing people 
COURSE: Operations Course (0.C.) (N=232) 
CORRELATION: .22 


Overall Performance in 0.C. 


Anal Coded Score Proficient & below Strong & above 
(eager for) 0-2 (N=71) hog, 58% 

3-4 (N=12h) 59% hig 
(reluctant 5-7 (N=37) 76% og, 
toward) 
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ie TEST: Strong Vocational Interest Inventory - CPA Partner Scale 
MEASURES: Interest pattern in comparison with CPA's 
COURSE: CT Orientation (N=257) 
CORRELATION: .18 


Overall Performance in CT Orientation 


CPA Partners Proficient & below Strong & above 
interests very dissimilar to (N=104) 37% 63% 
Interests moderately similar to (N=102) 30% 70% 
Interests very similar to (N=51) 1h% 86% 

Be TEST: Arithmetic Problems (AP) 


MEASURES: Arithmetic reasoning 
COURSE: Support Services Course for CTs (S.5.C.) (N=83) 
CORRELATION: .39 


Overall Performance in 5.5.C. 


AP Coded Score Proficient & below Strong & above 
(low) 0-3 (N15) 47% 53% 
heG (N=49) 23% 77% 
(high) 7-9 (N=19) Sfp 95% 
Gis TEST: Strong Vocational Interest Inventory - Author/Journalist Seale 


MEASURES: Interest pattern in comparison with writers 
COURSE: Intelligence Techniques (ITC) (N=270) 
CORRELATION: .15 


Overall Performance in IT¢ 
Author/Journelists Proficient & below Proficient‘ &« above 


Interests very dissimilar to (N=112) 59% 11g 
Interests moderately similar to (N=109) 56% hh 


Interests very similar to (N=9) 37% 63% 


=Da 
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TEST: Considerations (CON) 
MEASURES: Ability to generate ideas quickly 
COURSE: Operations Course (0.C.) (N=228) 
CORRELATION: .14 
Overall Performance in 0.C. 
CON Coded Score Proficient & below Strong & above 
(low) O-3 (N=56) 644 36% 
4-6 (N=114) 56% hh, 
(high) 7-9 (N&58) 50% 50% 
TEST: Work Attitudes - Physical (Phys) 
MEASURES: Eagerness for work involving physical hazards 
COURSE: CT Communism (N=332) 
CORRELATION: -.18 
Overall Performance in CT Communism 
Phys Coded Score Proficient & below Strong & above 
(eager for) 0-2 (N=132) 51% 49% 
3-4 (N=153) 36% ELS 
(reluctant 5-9 (N=47) 23% 77% 
toward) 
TEST: Reading Comprehension (RC-C) 
MEASURES: Reading comprehension 
COURSE: Intelligence Techniques (ITC) (N=278) 


CORRELATION: .2h 


Overall Performance in ITC 


RC-C Coded Seore 


Proficient & below Proficient™ & above 


(low) O-3 (N=51) 69% 31% 
46 (N&155) 54% L6% 
(high) 7-9 (N=72) 43% 57% 


-3- 
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REPRESENTATIVE SIGNIFICANT RELATIONSHIPS BETWEEN OVERALL 


EVALUATION IN TRAINING COURSES AND RATINGS OF 
JOB PERFORMANCE AND POTENTIAL 


COURSE: Intelligence Techniques (N=277) 
CRITERION: Rated overall job performance 
CORRELATION: .24 


Overall Training Evaluation Overall Job Performance 
Proficient) & below ‘Strong & above 


Proficient & below (N=149) SLA 16% 


Proficient’ & above (N=128) 40% 60% 


COURSE: Operations Course, Phase II (N=116) 
CRITERION: Rated overall job potential 
CORRELATION: .22 


Overall Training Evaluation Overall Job Potential 
Average & below Above average 

Proficient & below (N=95) 33% 67% 

Strong & above (N=21) 14% 86% 


COURSE: Intelligence Production (N=90) 
CRITERION: Rated qualitative aspects of job performance 
CORRELATION: ,.28 


Overall Training Evaluation Job Performance -- Qualitative 
Proficient’ & below Strong & above 


Proficient’ & below (N=52) 524, 48% 
Strong- and above (N=38) ahd 76% 
OCECRET 
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h, COURSE: CI Communism (N=332) 
CRITERION: Rated overall job potential 
CORRELATION: .18 


Overall Training Evaluation Overall Job Potential 
Average & below Above average 


Proficient & below (N=133) Li% 59% 
Strong & above (N=199) 26% 7h 
Be COURSE: OT Orientation (N=258) 


CRITERION: Rated quantitative aspects of performance 
CORRELATION: 14 


Overall Training Evaluation Job Performance -~_ Quantitative 
Proficient’ & below Strong & above 
Proficient & below (N=76) 51% 4o% 
Strong (N=133) Wh 53% 
Outstanding (N=49) 39% 61% 
Bs COURSE: Intelligence Techniques (1=268) 


CRITERION: Rated senior level (GS-15) potential 
CORRELATION: 26 


Overall Training Evaluation Senior Level Potential 
No Yes 
Proficient & below (N=ih3) 29% 71% 
Proficient’ & above (N=125) 10% 90% 
=De 
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COURSE: Operations Course (N=231) 
CRITERION: Rated qualitative aspects of performance 


' CORRELATION: .26 


Job Performance <-~ Qualitative 


Overall Training Evaluation 
Proficient & below Strong & above 


Proficient & below (N=131) 63% 37% 


Strong & above (N=100) 36% 64% 


COURSE: Operations Course (N=231) 
CRITERION: Rated overall job potential 
CORRELATION: +33 


Overall Job Potential 
Average & below Above average 


Overall Training Evaluation 


Proficient & below (N=131) els 51h 


Strong & above (lN=100) 21% 79% 


COURSE: CT Commnism (N=333) 
CRITERION: Rated overall job performance 
CORRELATION: .16 


Overall Traini Evaluation Overall Job Performance 
Proficient’ & below Strong & above 


Proficient & below (N=133) 574 43% 


Strong & above (N=200) big 56% 
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